Evaluation of Perceived Persuasiveness Constructs by Combining User Tests and Expert Assessments

To develop effective behaviour change support systems, persuasive technology can be used. The persuasive systems design model offers a framework to identify and operationalize such elements. In this pilot study, we evaluate the questionnaire developed to measure perceived persuasiveness of information technology. We analyzed verbatim user-test transcripts, and performed expert-assessments of the Nurse Antibiotic Information App (NAIA). These data were compared to questionnaire results on this app. Expert-assessment identified task support, perceived persuasiveness, unobtrusiveness, credibility, perceived effort and perceived effectiveness (as defined in the Persuasive Systems Design model) as being present within the NAIA. These constructs also scored satisfactory in the questionnaire. User-test transcripts are in line with questionnaire results. Given the consistent results in this pilot study, our approach seems promising for evaluating the questionnaire and will be applied to other settings and websites/applications.